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CHAPTER  8 


MARKOV  CHAIN  INITIALIZATION  MODELS  FOR  PACKET  RADIO  NETWORKS 


8.1  INTRODUCTION 


\ 


The  problem  of  initialization  of  repeaters  in  packet  radio  net- 
works is  addressed  in  this  Chapter  and  in  Chapter  9.  ^Repeaters  in 
the  radio  network  need  to  be  initialized  by  the  station;  namely,  to 
receive  a so-called  ‘*label^‘  which  enables  addressing  specific  de- 
vices during  packet  transportation.  It  is  assumed  that  a priori  the 
station  is  not  informed  of  the  existance  and  location  of  specific  re- 
peaters. Hence,  the  initialization  process  involves  sending  special 
control  packets,  called  Repeater  On  Packets  (ROP's)  from  repeaters 
to  the  station  to  inform  existance  and  location,  the  transmission  of 
labels  by  the  station  to  repeaters  identified,  and  the  transmission 
of  End-to-End  Acknowledgments  (ETE  Ack's)  by  repeaters  which  receive 
a label.  A repeater  is  considered  by  the  station  to  be  initialized 
after  the  station  receives  an  ETE  Ack  to  the  label  packet.  Yj 

Approximate  models  for  initialization  were  developed  anck  studied 
in  [NAC,  1976].  These  models  addressed  a single  hop  packet  radio  net- 
work with  general  interference  patterns  of  repeaters.  The  initializa- 
tion time  was  studied  in  [NAC,  1976]  as  a function  of  station  and 
repeater  transmission  rates.  However,  the  above  models  were  approxi- 
mate, in  that  the  exact  state  of  initialization  of  the  system  or 
station  buffer  size  and  management  were  not  taken  into  account, 
neither  was  an  exact  initialization  scenario  employed;  since  the 
objective  was  to  study  general  trends  of  initialization  time  as  a 
function  of  network  size  and  operating  parameters.  Hence,  conserva- 
tive, worst  case  initialization  times  were  obtained. 

In  this  Chapter  we  discuss  refined  models  that  provide  a more 
accurate  description  of  the  initialization  process.  Also,  the 
models  allow  us  to  analyze  the  case  of  a finite  buffer  in  the  station 
with  essentially  no  additional  complexity.  The  computational  com- 
plexity of  the  models  in  this  Chapter  are  significantly  greater  than 
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for  the  models  given  in  [NAC,  1976],  thus  only  small  networks 
(number  of  repeaters  £ 7)  with  complete  interference  have  been 
studied. 

In  Section  3 we  develop  a Markov  Chain  initialization  model 
for  a single  hop  complete  interference  system  (i.e.,  all  devices 
are  within  an  effective  transmission  range  of  each  other,  hence 
the  simultaneous  transmission  by  more  than  one  device  will  result 
in  an  interference) . The  computational  complexity  of  the  model 
is  obtained  and  numerical  studies  of  initialization  time  performed. 
In  Section  4 we  present  a Markov  Chain  model  for  a general  inter- 
ference system  and  derive  its  complexity.  The  model  appears  to  be 
too  complex  for  numerical  investigations.  The  initialization  prob- 
lem is  stated  in  Section  2. 

The  models  in  this  Chapter  assume  that  when  the  station  has 
more  than  one  label  (for  transmission)  in  its  queue,  the  label  to 
be  transmitted  is  selected  at  random,  each  time.  The  models  in 
Chapter  9 assume  a First-In-First-Out  (FIFO)  label  queue  management 
discipline;  this  results  in  a system  with  reduced  computational  com- 
plexity and  enables  to  address  larger  size  systems  (number  of  re- 
peaters) . 
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8.2  PROBLEM  DEFINITION 


The  packet  radio  system,  related  properties  and  the  initializa- 
tion scenario  are  presented  by  the  outline  below: 

1.  Single  station,  S,  and  m repeaters, 

Rj , j=l , . • . ,m. 

2.  Each  repeater  can  communicate  with  the 
station  (1  hop  system) . 

3.  Each  repeater  can  communicate  with  all  other 
repeaters  (complete  interference) . This  re- 
quirement is  modified  in  Section  4. 

4.  Zero  propagation  time  of  signals  between 
devices. 

5.  Single  channel  slotted  Aloha  access  scheme. 

That  is,  all  repeaters  transmit  and  receive 
(hence  the  station  transmits)  on  the  same 
channel,  consequently  interference  between 
any  two  devices  is  possible.  Furthermore, 
the  slotted  Aloha  channel  access  scheme 

is  used  [ABRAMSON,  1973]. 

6.  Zero  capture  receivers.  That  is,  if  more 
than  one  packet  is  transmitted  into  a slot, 
it  is  assumed  that  all  packets  will  be  re- 
ceived in  error. 

7.  When  forwarding  ROP's,  each  repeater  broad- 
casts into  a given  slot  with  probability  p. 
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8.  No  repeater  accepts  repeater  on  packets 
(ROP's)  or  end-to-end  acknowledgments 
(ETE  Ack's)  from  other  repeaters. 

9.  If  a repeater  receives  its  label  from  the 
station,  it  forwards  one  ETE  Ack  into  the 
next  slot  and  halts  transmission  of  ROP’s. 

10.  After  the  station  receives  a ROP  from  a 
particular  repeater  for  the  first  time,  the 
station  prepares  a label  for  that  repeater 
and  places  it  in  the  label  queue.  We  assume 
this  requires  zero  processing  time. 


11.  The  station  maintains  the  repeater  label  in 
the  queue  until  it  forwards  the  label  to  the 
repeater  and  receives  an  ETE  Ack,  indicating 
the  label  has  been  received.  When  this  occurs, 
the  repeater  is  considered  labeled. 

12.  When  the  label  queue  is  not  empty,  the  station 
transmits  a label  with  probability  q. 

13.  When  transmitting  a label,  the  station  randomly 
selects  a label  from  the  queue.  We  assume  it  is 
equiprobable  that  any  label  is  chosen,  thus  the 
probability  of  choosing  any  particular  label  is 


(number  of  labels  in  the  queue) . 

14.  Whenever  the  station  receives  an  ROP  from  a re- 
peater for  which  it  already  has  prepared  a label, 
it  disregards  the  ROP. 
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15.  Finite  buffer  size,  b,  i.e.,  the  number  of  labels 
in  the  label  queue  cannot  exceed  b.  Whenever 
b > m,  this  does  not  introduce  any  constraint  on 
the  initialization  process. 
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8. 3 A MARKOV  CHAIN  INITIALIZATION  MODEL  FOR  A COMPLETE  INTERFERENCE 

SYSTEM 

This  initialization  process  can  be  readily  understood  by  analyz- 
ing the  status  of  an  arbitrary  repeater  as  the  process  evolves.  *>. 

Specifically,  at  any  time  during  the  initialization  process,  a 
repeater  will  have  one  of  the  following  statuses: 

1.  Transmitting  ROP's,  but  has  not  successfully 
sent  one  to  the  station. 

2.  Transmitting  ROP's,  but  has  already  successfully 
sent  one  to  the  station. 

3.  Received  a label  from  station  in  previous 
slot,  will  forward  ETE  Ack  to  the  station 
in  next  slot. 

4.  Awaiting  another  label  from  station.  It  has 
received  at  least  one  label  from  the  station 
but  the  subsequent  ETE  Ack('s)  were  unsuccess- 
ful. In  this  case  the  repeater  is  not  trans- 
mitting ROP's. 

5.  Completed  initialization:  repeater  has  received 

label  from  station  and  forwarded  a successful 
acknowledgment . 

The  initialization  process  is  begun  with  all  repeaters  having 
status  1 above  and  is  completed  when  all  repeaters  have  status  5. 
Figure  1 illustrates  the  relationship  between  the  aforementioned 
statuses.  As  discussed  above,  a repeater  begins  the  initialization 
process  with  status  1 during  which  the  repeater  is  transmitting 
ROP's  to  the  station.  When  one  of  these  ROP's  reaches  the  station. 
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the  repeater  acquires  status  2,  but  it  continues  to  transmit  ROP's. 

The  next  change  in  status  occurs  when  the  station  successfully  sends 
a label  to  the  repeater.  At  this  time  the  repeater  acquires  status 
3 and  ceases  transmitting  ROP's.  In  the  slot  immediately  following 
the  slot  in  which  it  received  the  label,  the  repeater  will  forward 
an  ETE  Ack  to  the  station.  If  this  Ack  is  received  by  the  station, 
the  initialization  of  this  repeater  is  complete  and  it  acquires 
status  5.  Otherwise,  the  repeater  takes  on  status  4 where  it  awaits 
the  receipt  of  another  label.  In  this  case  the  repeater  will  re- 
acquire status  3 when  it  receives  another  label  and  the  action 
described  above  for  status  3 will  be  repeated.  Eventually  the  re- 
repeater will  acquire  status  5. 

Note  that  since  the  station  can  forward  only  one  label  in  any 
particular  slot,  at  most  one  repeater  can  have  status  3 at  any  given 
time.  Also,  the  finite  buffer  size  assumption  requires  that  the 
total  number  of  repeaters  having  statuses  2,  3,  and  4 cannot  exceed  b. 

8.3.1  Mathematical  Formulation 


In  order  to  compute  the  expected  time  to  initialize  all  re- 
peaters, we  introduce  a Markov  Chain  based  on  the  repeater  statuses 
discussed  above.  Given  the  status  of  each  repeater  at  a particular 
time  during  the  initialization  process,  we  define  the  state  of  the 
chain  as  the  quintuple  (m,  , m_,  m-.,  m. , mc)  , where  m.  denotes  the 

J.  /.  J 4 D 1 

number  of  repeaters  with  status  i at  that  time.  From  the  previous 
section  it  is  clear  that  nu,  i = 1,  ...,  5 are  integers  satisfying 

0 < m . < m , i»l,  ...»  5,  i^3. 

0 < m3  < 1 

m2  + m3  + m4  — k (buffer  size  constraint) . 


Because  of  the  assumptions  of  complete  interference  and  zero 
capture,  it  is  simple  to  compute  the  state  transition  matrix.  First 
note  that: 


• For  a packet  to  be  successfully  sent  from  a 
repeater  to  the  station,  all  other  repeaters 
and  the  station  must  be  silent. 

• For  a packet  to  be  successfully  sent  from 
the  station  to  a repeater  requires  all 
repeaters  to  be  silent. 

Given  the  current  state  of  the  chain  (m^,  m 2,  m^,  m^ , m,-)  , the 
following  list  enumerates  all  possible  transitions.  For  conve- 
nience, the  cases  m3=0  an^  m3=^  are  treated  separately. 

A.  No  repeater  received  a label  in  the  previous  slot 
(m3=0)  . 

( 

l.a  Successful  ROP  when  station  queue  not 

empty.  This  requires  m^  >0,  0 < < b. 

Transition  to  state  (n^-1,  m2+l,  m4 ' m5^ 

m.  + m2-* 

occurs  with  probability  (l-qjm^p (1-p)  = 

l.b  Successful  ROP  when  station  queue  is 

empty.  This  requires  m^  > 0,  m2  + n>4  = 0. 
Transition  to  state  (m^-1,  n^+l,  0,  m^,  m,.) 

occurs  with  probability  m.^  p(l-p)ml  + m2  1 = z^. 
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2.  Successful  label  to  a repeater  with  status  2. 
This  requires  m2  > 0.  Transition  to  state 
(m^,  m2“l,  1#  m4,  m,.)  occurs  with  probability 

(l-p)ml  + m2  q m2/(m2+m4)  = Zy 

3.  Successful  label  to  a repeater  with  status  4. 
This  requires  m4  > 0.  Transition  to  state 
(m^ , m 2,  1,  m^-1,  m^)  occurs  with  probability 

(l-p)ml+m2  q m4/(m2+m4)  = Zy 

4.  Otherwise  the  status  remains  the  same. 

This  occurs  with  probability  1-z^  “ z2  “ z3* 

B.  A repeater  received  a label  in  the  previous  slot. 
(m3=l) 

1.  Successful  ETE  Ack.  Transition  to  state 
(m^ ,m2 , 0 ,m4 ,m^+l ) occurs  with  probability 

(l-p)ml  + m2  (1-q) . 

2.  Unsuccessful  ETE  Ack.  Transition  to 
state  (m3,m2, 0,m4+l,m3)  occurs  with 

probability  l-(l-p)ml+m2  (1-q). 


To  facilitate  our  analysis,  upon  reaching  the  completely 
initialized  state,  (0,0,0,0,m),  we  restart  the  process  by  trans- 
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The  Markov  Chain  is  both  aperiodic  and 
irreducible. 

The  initialization  time  is  the  interarrival 
times  between  visits  to  state  (0,0,0,0,m) 
minus  1. 
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Computation  of  the  stationary  vector,  tt,  involves  solving 
the  linear  equations 


These  are  n+1  equations  with  n unknowns  The  nxn  matrix  (I-I) 

has  rank  n-1,  and  any  one  of  its  equations  may  be  dropped  to  form 
a full  rank  system.  The  solution  can  then  be  obtained  by 
Gaussian  elimination.  When  m is  large,  however,  it  may  be 
necessary  to  employ  sparse  matrix  techniques  in  the  Gaussian 
elimination. 


Number  of  States  in  the  Chain 


Since  linear  equations  must  be  solved  to  determine  the  expected 
initialization  time,  it  is  important  that  the  number  of  states  not 
grow  too  rapidly  as  the  number  of  repeaters  increase.  We  consider 
two  cases, 


Infinite  buffer  b=m,  (b=m  is  equivalent 
to  unlimited  buffer  size  since  more  are 
not  needed  for  labeling  m repeaters) . 
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The  problem  of  determining  the  number  of  states  is  equivalent 
to  determining  how  many  different  ways  m identical  elements  can  be 
put  into  5 different  sets,  G^,  i=l,  ...»  m with  the  proviso  one  set, 
say  G^,  can  have  at  most  one  element  in  it.  Note  the  set  G^  corres- 
ponds to  status  3 in  the  Markov  Chain.  We  solve  the  problem  itera- 
tively. First  let  m-k.^  elements  be  put  in  sets  G^ , G2,  and  G^ , 
then  the  remaining  k-^  elements  are  partitioned  into  the  sets  G^  and 
G,.  in  k^+1  different  ways.  Now  suppose  m-k2  elements  are  parti- 
tioned into  G^  and  G2;  then  the  remaining  k2  elements  can  be  par- 
titioned so  ^2“k^  are  in  G^  and  k^  are  in  G^  and  G,..  Applying  the 


result  for  when  the  elements  in  G^,  G2,  and  G3  were  fixed  and  sum- 


ming, we  now  find  total  number  of  combinations  is 


k2 

E 


(k2+2)  (k2+l) 


k1=0 


(kj+1)  = 


(7) 


Now  consider  two  possible  cases  for  G^,  since  it  can  contain  at 


most  1 element.  Suppose  G^  = <J>,  and  that  G2  contains  m-k2  elements, 


Applying  equation  (7)  and  summing  over  allowable  k2,  we  obtain 


m (k2+2) (k2+l) 
E 5 

V° 


(8) 


Similarly  when  G^  contains  1 element  and  G2  contains  m-l-k2, 
we  obtain 


m-1  (k2+2) (k2+l) 

£ 


(9) 


k2=° 


The  total  number  of  combinations  is  just  the  sum  of  (8)  and  (9), 
namely: 


m-1 


E (k+2)  (k+1)  + (m+2  j, 
k=0  * 


(10) 
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The  corresponding  values  in  (10)  for  m=3,  10  are  given  in 

Table  1. 

Our  numerical  results  show  that  to  compute  the  expected  ini- 
tialization time  using  a PDP-10  on  ARPANET  requires  approximately: 

• 3 CPU  seconds  for  a PR  network  with  3 repeaters 
and  3 buffers. 

• 10  CPU  seconds  for  a PR  network  with  4 repeaters 
and  4 buffers. 

• 34  CPU  seconds  for  a PR  network  with  5 repeaters 
and  5 buffers. 


In  these  computations,  we  did  not  utilize  the  sparsity  of  the  trans- 
ition matrix.  To  compute  initialization  times  for  PR  networks  with 
more  repeaters  it  would  be  highly  advantageous  to  employ  sparse 
matrix  methods. 

Now  consider  the  case  where  buffer  size  is  fixed  equal  to  b 
and  the  number  of  repeaters  m increases.  We  want  to  determine  the 
asymptotic  behavior  of  the  number  of  states  in  the  Markov  Chain. 
Again  this  can  be  analyzed  in  terms  of  partitioning  m identical 
elements  into  5 sets  with  the  provisos: 


X' 


One  set,  G^,  can  have  at  most  1 element. 


The  total  number  of  elements  in  sets  G^, 
G2,  and  G^  is  less  than  b. 


• i 

V 

<■-* 

v: 


To  compute  the  number  of  states,  the  above  results  can  be  used. 
Suppose  there  are  l elements  in  G^ , G2,  and  G^  and  m-j,  elements 
in  sets  G^  and  G,..  Reasoning  as  above,  we  can  show  that  there  are 
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3 

4 

5 

6 

7 

8 
9 

10 


30 

55 

91 

138 

204 

290 

395 

510 


TABLE  1:  NUMBER  OF  STATES  IN  THE  MARKOV  CHAIN  AS  A 

r ' 

FUNCTION  OF  NUMBER  OF  REPEATERS  FOR  b=m 

iff 


* 

•« 


‘J 


NETWORK  ANALYSIS  CORPORATION 


2JI+1  ways  in  which  the  l elements  can  be  partitioned  in  the  sets 
G^,  Gj#  and  G^;  and  m-fc+1  ways  the  m-Ji  elements  can  be  partitioned 
in  the  sets  G^  and  G^.  Thus  given  i.  there  are  (2&+1)  (m-£+l)  ways 

of  partitioning.  Summing  over  all  permissible  l,  we  determine  the 
total  number  of  states: 

b 

1 (2S.+1)  (m-JL+1)  (11) 

£=0 

However,  since  0££<b,  we  see 
b b 

l (2JI+1)  (m-£+l)  < Z (2b+l)  (m+1)  < (2b+l)  (b+1)  (m+1)  (12) 

fc=0  *,=  0 

Thus  as  m increases  and  b stays  fixed,  the  number  of  states  is 
bounded  by  a linear  function  of  m.  This  result  indicates  that 
if  we  restrict  the  buffer  size,  we  will  be  able  to  compute  ini- 
tialization times  for  large  PR  networks. 

8.3.3  Computational  Results 

The  formulae  obtained  via  the  Markov  Chain  initialization 
model  were  programmed  and  the  initialization  time  of  radio  net- 
works was  studied  as  a function  of  number  of  repeaters,  number 
of  station  buffers  and  the  transmission  rates  by  repeaters  and 
stations. 

In  the  first  series  of  experiments  we  studied  the  systems 
with  m=3,  4,  and  5,  and  b=m.  The  repeater  transmission  rate, 
p,  was  systematically  varied  to  approximate  minimal  initialization 
time.  These  results  are  tabulated  in  Table  2 and  illustrated  in 
Figures  1,  2,  and  3,  where  the  initialization  times  are  plotted 
as  a function  of  p for  various  values  of  station  transmission 
rates  q.  Boxed  entries  in 'Table  2 indicate  minimal  values. 
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q=.3 


q=.4 


q=.  5 


q=.  6 


m=3  b=3 

ii 

A 

II 

£ 

m=5  b=5 

p=.  05 

Tj.  = 51.93 

Tj  = 61.85 

Tx  = 71.17 

.10 

36.44 

46.19 

56.77 

.15 

33.67 

45.68 

60.03 

.20 

34.43 

49.76 

69.17 

.25 

36.98 

56.57 

82.54 

.30 

40.86 

65.95 

100.84 

p=.  05 

52.09 

62.36 

72.03 

.10 

35.96 

45.53  • 

| 55.68  I 

.15 

32.44 

43.56 

56.44 

.20 

( 32.37  | 

45.99 

62.75 

.25 

33.97 

50.87 

72.71 

.30 

36.76 

57.88 

86.58 

p= . 05 

53.48 

64.48 

74.93 

.10 

37.11 

47.28 

58.00 

.15 

33.27 

44.69 

57.65 

.20 

32.80 

46.29 

62.42 

.25 

33.90 

50.08 

70.37 

.30 

36.07 

55.69 

81.51 

p=.  05 

56.23 

68.42 

80.15 

.10 

37.11 

51.34 

63.49 

.15 

35.99 

48.68 

62.96 

.20 

35.39 

50.000 

67.09 

.25 

36.28 

53.27 

73.92 

.30 

38.12 

58.07 

83.43 

TABLE  2:  STUDY  ON  REPEATER  RATE  AND  STATION  RATE  FOR  b=m 


FIGURE  1:  INITIALIZATION  TIME  AS  A FUNCTION  OF  REPEATER  TRANSMISSION  RATE  FOR  m=b=3 
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First  note  the  convex  shape  of  the  curves  in  these  figures. 

We  conjecture  that  this  convexity  in  p holds  for  all  values  of 
q,  m,  and  b but  have  not  endeavored  to  prove  it.  Because  of  this 
convexity  and  the  continuity  of  the  initialization  times  as  a 
function  of  p and  q (for  physical  reasons) , these  curves  give  a 
good  indication  of  the  optimal  values  of  p and  q. 

From  each  of  these  figures  it  is  clear  that  if  a poor  repeater 
rate  is  selected  (e.g.,  p=.05)  the  initialization  time  will  be 
high  regardless  of  what  the  station  rate  q is.  However,  if  a poor 
station  rate  is  chosen  (e.g.,  q=0.6)  but  a correspondingly  good 
repeater  rate  is  chosen,  the  effect  on  initialization  time  will  be 
relatively  small.  Thus  we  conclude  that  the  initialization  is  more 
sensitive  to  the  repeater  transmission  rate  of  ROP's  than  the  sta- 
tion transmission  rate  of  labels,  for  the  range  of  p and  q investi- 
gated, i.e.,  values  near  the  optima. 

Comparing  Figure  1 through  3,  we  note  that  as  the  number  of  re- 
peaters increases;  the  optimal  values  of  repeater  rate  decreases 
while  the  optimal  station  rate  remains  the  same.  Realistically, 
we  feel  the  optimal  station  rate  is  not  independent  of  m,  but  that 
the  courseness  of  our  systematic  search  prevents  us  from  detecting 
the  sensitivity  of  the  initialization  time  to  the  station  rate. 
However,  we  feel  it  is  valid  to  conclude  that  as  the  number  of 
repeaters  increase,  it  is  more  important  to  optimally  adjust  the 
repeater  rate  than  the  station  rate. 

It  is  interesting  to  note  that  the  combined  repeater  rate  (i.e., 
the  total  transmission  rate  of  all  repeaters)  mp  for  optimal  values 
of  p remains  relatively  constant.  Specifically,  we  obtained: 


m = 3; 
m = 4; 
m = 5; 


mp  = (3) . 2 = . 6 

mp  = (4). 15  - .6 
mp  = (5). 10  = .5 


trv 

► 


Since  m is  an  integer,  it  is  necessary  to  carry  out  a more  refined 
systematic  search  for  a larger  number  of  repeaters  to  detect  the 
sensitivity  of  the  combined  repeater  rate  to  the  number  of  repeaters. 
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To  analyze  the  effect  of  a finite  buffer,  we  have  system- 
atically varied  p and  q for  a 5 repeater  network  with  the  number 
of  buffers  b = 1,  2,  3,  4,  and  5.  The  entries  in  Table  3 are  the 
resulting  minimal  initialization  times,  and  Figure  4 clearly 
indicates  the  expected  decreasing  returns  to  scale  property  of 
additional  buffers.  This  implies  that  if  b is  somewhat  smaller 
than  m,  the  initialization  time  is  not  appreciably  affected.  One 
way  of  interpreting  this  result  is  that  when  a 5 repeater  system 
has  4 or  5 buffers,  only  in  rare  instances  will  the  station  have 
4 or  5 labels  in  the  label  queue.  Alternatively,  when  the 
station  only  has  3 buffers,  only  in  rare  instances  will  an  ROP 
not  be  accepted  because  the  label  queue  is  full. 

Choosing  the  number  of  buffers  equal  to  approximately  one- 
half  the  number  of  repeaters,  we  systematically  varied  p and 
q to  determine  the  minimal  initialization  time  as  a function  of 
m.  These  results  are  listed  in  Table  4 and  illustrated  in  Figure 
5.  Because  m and  b are  integers,  it  is  not  possible  that  b/m  be 
exactly  one-half  in  all  cases.  Surprisingly,  however,  the  initiali- 
zation times  increase  nearly  linearly  over  the  range  of  m considered. 
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8.4.  A MARKOV  CHAIN  INITIALIZATION  MODEL  FOR  A SYSTEM  WITH  GENERAL 
INTERFERENCE  PATTERN 


8.4.1  Introduction 


In  the  previous  section  a Markov  Chain  model  for  the  initiali- 
zation of  1-hop  PRNET  with  complete  interference  has  been  presented 
and  analyzed.  The  model  assumed  that  once  a device  is  broadcasting, 
every  other  device  is  blocked.  This  may  not  (and  in  fact,  should 
not)  occur  in  a real  network  where  the  repeaters  are  at  a consider- 
able distance  from  each  other.  In  this  section  we  extend  the  pre- 
vious model  by  considering  general  interference  patterns. 

In  the  general  interference  environment,  we  need  detailed 
information  as  to  which  repeaters  have  already  been  initialized,  and 
are  thus  quiet,  consequently  we  can  expect  a higher  number  of 
states  in  the  present  model  than  in  the  previous  model.  Hence,  the 
computational  complexity  will  increase. 

8.4.2  Mathematical  Formulation 


The  assumptions  which  define  the  model  are  the  same  as  in 
Section  2 with  the  following  modifications: 

1.  To  each  repeater  R^,  there  corresponds  a set 
of  interfering  repeaters,  with  R.  e S$D^. 

2.  When  sending  ROP's,  repeater  is  broadcasting 
into  a given  slot  with  probability  p^. 
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Infinite  station  buffer  size  for  labels. 


{ R j | j = 1,2, 


.m}  denote  the  given  set  of  repeaters. 


Let  p (R)  be  the  power  set  of  R,  the  set  of  all  subsets  of  R. 

Let  e p (R)  be  the  set  of  repeaters  which  at  a given  slot  are  in 
status  i,  l<i<5.  We  write 


= {R, 


Rj  > 

3k(i) 


Let  | G± | = nu  be  the  cardinality  of  set  G^ . 


Let  o = p (R)  x p (R)  x p (R)  x p (R)  x p (R)  = p5(R) 
Consider  $C  a with 


5 

G_J<1,  G.  n G.  = <j>,  for  l<i,j£5,  U G.=R} 
J 1 J i=l 

(14) 

Finally  define  a Markov  Chain  whose  states  are  the  points  of  $ and 
transition  probabilities  are  to  be  discussed. 

r ' 

Comments: 

1.  a represents  all  quintuples  (G^»G2, G3,G4,G,.)  whose 

. . entries  are  subsets  of  R. 

; .t 

| 

2.  $ represents  all  allowable  quintuples  in  reference 
to  the  above  assumptions.  For  example,  we  can  only 


$ = { (g1,g2,g3,g4,g5),  | 


have  one  repeater  in  status  3 
out  in  the  previous  model. 
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3.  n = | § | represents  the  number  of  states  in  the  Markov 
Chain.  We  derive  later  an  exact  expression  for  n- 

4.  If  = R for  all  i,  this  model  reduces  to  the 
previous  one. 

The  following  discussion  addresses  the  computation  of  the  state 
transition  matrix.  Consider  the  possible  transitions  from  the 
state  $L  = (G^'^iG^jG^G^)  , with  L representing  the  time  slot. 

Case  1.  = <J> 

The  following  transitions  are  possible. 


1.  This  transition  represents  successful  reception 
of  a ROP.  Any  one  of  m^  = Jg^I  states  (when 
. m^  j1  0)  are  reached: 

$Tj.t  = (0-,-{R.;*}»  G0  U *} » <t> , G4 , G,.)  , f°r  e 


'L+l  VVJ1  1 ' ~2 


(15) 


with  probability 

r 


i*  n u-pv 

3 VGlUG2"{Rj*} 


(1-P„)  (1-q)  , if  m2  + m4  > 0 


pj* 


VGlUG2_{Rj*} 


d-Pv> 


, if  mj  + m^  = 0 


(16) 


If  p * p for  all  x (henceforth  called  "normality")  we  obtain: 
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Zt*  = 


m.  + m-  -1 

p(l-p)  1 * (1-q) 


P(l-P) 


ml  + m2  ”1 


, if  n>2  + ra4  > 0 


, if  m2  + m4  = 0 


(17) 


2.  This  transition  represents  successful  reception 
of  a label.  Any  one  of  m2  = |g2|  states  (when 
m2^  0)  are  reached: 

$L+1  = (G1,G2-{Rj*),  Rj*»  G4,  G5)  , for  R.*  e G2 


with  probability 


(18) 


zj*  ■ H (1-pv>  ET  * sr 

VG1  U G2  n °Rj* 


(19) 


(observe  that  + m.  > 0,  since  m~  > 0) 


Under  normality. 


Z-*  = U-P> 


lGi  ^g2  n dr  • a 

3 + 


m2  + m4 


(20) 


3.  This  transition  represents  successful  re-reception 
of  a label.  Any  one  of  m4  = |G4|  states  (when 
m43*0)  are  reached: 


$L+1  = (Gi»G2'{Rj*}'  G4  G5)  for  Rj*  e G4 


(21) 


with  probability 


zj* 


RvcGl  " G2  n V. 

J 


•i-Pv'  57*+ 


2 ’ m4 


(22) 


9 
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Under  normality, 

4 |GX  U G H D | 

Zj*  = (1-P)  3* 


(23) 


4.  Remain  in  same  state  with  probability 


12  4 

1 - E Z.  - E Z.  - E z; 

Rj  eG1  D RjEG2  3 RjeG4  3 


(24) 


where  a summation  over  the  empty  set  is  0. 


Case  2.  G_  = {R.} 
_ 3 


1.  This  transition  represents  successful  ETE 
reception.  Transition  is  to  state 

$L+i  = <Gi'G2'  ^ ,G4  ,G5 

with  probability: 


r = n 


VG1  U G2 


(l-pv) (1-q) 


(25) 


under  normality. 


m.+m, 

r = (1-p)  X ^ (1-q) 


(26) 


2.  This  transition  represents  unsuccessful  ETE 
Ack.  Transition  is  to  state 

$L+1  = (G1,G2,  (Jr,G4  U{Rj } , Gj. ) with  probabil- 
ity 1-r. 
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Case  3.  Transition  back  to  initial  state 

1.  Consider  = (<J> , <|> , 4> , » R)  • We  assume 

that  transition  occurs  to  state  = {R,4>,4>,<J>,4>} 

with  probability  1. 

Comments 

1.  Figure  6 depicts  the  partial  state  diagram  for 
a 3-repeater  example. 

2.  Observe  the  divergence  from  the  model  in  Sec- 
tion 3 at  Case  1.2  and  1.3.  The  latter  model 
is  recaptured  by  taking  = R for  all  i. 

Then,  in  order  to  have  a transition  from 

(G^  ,G2 , <j>  ,G^)  to  (G^,G2  ~ {Rj*)r  Gj.)  , 

for  R.*  c G_,  namely,  a label  is  successfully 
3 * 

received  by  Rj*,  we  require  that  every  unlabeled 
repeater  is  silent,  which  occurs  with  probability 

|G,  UG2I 

( ( 1— p)  ) . In  the  present  model  we  only 

require  that  every  unlabeled  repeater  which 
interferes  with  R^*  is  silent.  (Thus,  the  prob- 

|G  U G H D | 

ability  is  ( 1— p ) J ) . Similarly  for 

case  1.3. 

3.  A finite  buffer  size  constraint  is  easily 
added  to  the  model  by  readjusting  the  trans- 
ition probabilities  to  0 when  the  buffer  is 
full. 
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D2  = {R-j » R2 » R3> 
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8.4.3  Calculation  of  Number  of  States 


The  cardinality  of  $ is  derived  below  in  terms  of  number 
theoretic  quantities. 


Let: 


a.  | R | = m 


b. 


be  the  number  of  partitions  of  m elements 


into  exactly  5 groups. 


TP. (m) , the  i-th  component  of  the  L-th  partition, 

Li  1 


is  the  number  of  elements  in  the  i-th  group 
ordered  as 


LP.+1(m)  < LPi(m)  , l<i<5. 


(27) 


with  P.(m)  = 0 if  necessary. 
Li  1 


d. 


TK.(m)  be  the  number  of  groups  in  the 
l 3 


L-th  partition  of  m elements  having  j 
elements . 


From  these  definitions  it  follows  that 
5 


m = E TP.  (m)  , 

i=lL  1 


KL<£ 
sm 


m 


b.  m = E j.K.  (m) 
j = 0 L 3 


(28) 

(29) 
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b r if  TP.  (m)  < 1 

* p (m)  (b:  - • a'  X C 

;«  * / ■ ' *.X  f.  # ‘ 

• .7  ‘ t,""'  * • * - 

We  then  claim  that  , fixe,  jxumber  of  sta±es:*Jjn  .t&e  J&arkx>'T  Chain  is 

1 -i  o.  < k 

given  by:  » 


'm-  E TP,  (m) 


$|  = E v=0  \ LPv+l  m 
L=1  m 

n k , 
j=o  L ] • 


n $ ( 5— i ) 

i=0  Lpi 


L”X)WV*'‘ 


Proof:  Consider  a given  partition  L,  given  by  P.(m),  i=l,  ...,5. 

She  - merator  term  involving  the  product  of  the  binomials  represents 
the  number  of  ways  we  can  partition  m elements  (repeaters)  into 
groups  Gv+1  having  L?v+1 (m)  elements,  v + 1 = 1,  2,  . ..,^5,  with 
duplication,  i.e.,  two  groups  may  have  same  number  of  elements.  The 
denominator  term  eliminates  the  duplicate  copies  due  to  permutation, 
embodied  in  the  partition  operation  of  the  numerator,  i.e.,  due  to 
two  groups  having  same  number  of  elements.  Finally  the  product  term 
represents  how  the  distinct  partition  groups  , l<i<5,  can  be  as- 
signed to  a particular  status;  if  a set  has  more  than  one  element  it 

can  only  be  placed  into  any  of  5-i-l  statuses,  where  l<i<J5  represents 

• * 

the  statuses  already  filled  up;  if  the  set  has  one  or  no  element  in 
it,  it  can  be  placed  into  any  of  5-i  statuses.  Condensed  mathemat- 
ically, any  set  can  be  placed  into  4>  p (5-i)  statuses.  The  above 

L l 

restriction  is  imposed  by  the  fact  that  at  most  one  repeater  can  be 
in  status  3,  during  any  ALOHA  slot. 
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Computations  show  that: 


| $ (3) ) = 112 
|$(4)  | = 488 
| $ (5)  | = 2320 

The  solution  strategy  should  follow  the  procedure  used  for  the 
model  in  Section  3. 


-----  - • — - ■ 


NETWORK  ANALYSIS  CORPORATION 


8.5  CONCLUSIONS 


Markov  Chain  initialization  models  for  a single  hop  packet 
radio  network  were  developed;  network  initialization  time  was 
studied  as  a function  of  number  of  repeaters,  number  of  station 
buffers,  transmission  rates  of  ROP's  by  repeaters,  and  trans- 
mission rate  of  labels  by  the  station.  The  models  appear  to  be 
complex  from  the  computational  viewpoint;  namely,  the  number  of 
states  of  the  chain  is  of  the  order  O(m^),  m being  the  number  of 
repeaters  (the  complexities  of  the  models  were  derived) . The 
high  complexity  enabled  the  numerical  investigation  of  small  net- 
works only  of  up  to  7 repeaters,  and  this  could  be  done  for  one 
of  the  models  only,  which  assumed  a complete  interference  system 
in  which  all  repeaters  and  the  station  are  within  an  effective 
transmission  range  of  each  other. 

The  computational  results  suggest  the  following  conclusions: 

• Initialization  times  are  more  sensitive 
to  repeater  transmission  rates  than  sta- 
tion rates. 

• Initialization  times  are  not  significantly 
increased  if  there  are  somewhat  fewer  buffers 
in  the  station  (for  initialization)  than  the 
number  of  repeaters. 

• Initialization  times  increase  nearly  linearly 
as  the  number  of  repeaters  increases  (with 
the  number  of  buffers  in  the  station  equal  to 
approximately  1/2  the  number  of  repeaters) . 

• Optimal  repeater  .transmission  rates  decrease 
as  the  number  of  repeaters  increase. 

• The  total  transmission  rate  of  all  repeaters 
is  nearly  constant. 
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CHAPTER  9 


A MARKOV  CHAIN  INITIALIZATION  MODEL  WITH  FIFO  LABEL  QUEUE 
MANAGEMENT  AT  THE  STATION 


9.1  INTRODUCTION 


We  address  the  problem  of  intialization  of  repeaters  in  packet 
radio  networks.  Repeaters  in  the  radio  network  need  to  be  initial- 
ized by  the  station;  namely,  to  receive  a so-called  "label"  which 
enables  addressing  specific  devices  during  packet  transportation. 

It  is  assumed  that  a priori  the  station  is  not  informed  of  the 
existence  and  location  of  specific  repeaters.  Hence,  the  initial- 
ization process  involves  sending  special  control  packets,  called 
Repeater  On  Packets  (ROP's)  from  repeaters  to  the  station  to  inform 
existence  and  location,  the  transmission  of  labels  by  the  station  to 
repeaters  identified,  and  the  transmission  of  End-to-End  Acknowledg- 
ments (ETE  Ack)  by  repeaters  which  receive  a label.  A repeater  is 
considered  by  the  station  to  be  initialized  after  the  station  re- 
ceives an  ETE  Ack  to  the  label  packet.  The  more  interesting  initiali 
zation  problem  is  for  multi-hop  packet  radio  networks  which  will  be 
the  structure  of  practical  systems.  However,  such  systems  are  too 
complex  and  do  not  lend  themselves  to  analysis.  Nevertheless,  the 
model  and  results  for  initialization  of  single-hop  networks  present- 
ed in  this  chapter  provides  much  insight  into  the  behavior  of  the 
initialization  time  and  the  proper  transmission  rates  of  repeaters 
and  station  to  obtain  minimum  initialization  time. 

In  Chapter  8 we  discuss  a Markov  Chain  model  for  initialization 
of  1-hop  packet  radio  networks.  This  model  is  conceptually  very 
useful,  but  in  order  to  compute  the  total  initialization  time,  it  is 
necessary  to  solve  a set  of  linear  simultaneous  equations.  For  an 
m repeater  network  the  number  of  such  equations  turns  out  to  be 

3 

0(m  ).  Hence  this  model  is  not  applicable  for  analyzing  large  net- 
works. Also,  only  a model  -for  complete  interference  is  implemented. 
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The  complexity  of  the  model  in  Chapter  8 can  be  reduced  by 
modifying  the  label  queue  management  from  a random  selection  dis- 
cipline to  a first  in,  first  out  (FIFO)  discipline,  the  number  of 

linear  simultaneous  equations  that  need  be  solved  can  be  reduced 
3 2 

from  0 (m  ) to  0 (m  ) . In  this  chapter  we: 

1.  Formulate  a new  Markov  Chain  initialization  model 
based  on  FIFO  queue  management. 

2.  Establish  that  the  complexity  of  this  model  is 
0 (m2) . 

3.  Derive  exact  solutions  for  this  new  model  when 
the  station  has  1 or  2 buffers  for  the  complete 
interference  case. 

4.  Derive  approximate  solutions  for  this  new  model 
when  the  station  has  1 or  2 buffers  for  the  general 
interference  case. 

5.  Study  numerically  the  solution  and  obtain  results 
for  the  proper  transmission  rates  of  station  and 
repeaters  to  minimize  the  initialization  time,  as 
a function  of  number  of  repeaters,  interference 
between  repeaters  and  number  of  station  buffers. 
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9.2  MODEL  DEFINITION  AND  ASSUMPTIONS 


In  this  analysis  we  make  virtually  the  same  assumptions  of 
Chapter  8,  except  where  noted.  We  are  concerned  with  a PR  net- 
work having  the  following  characteristics: 

$ 

1.  Single  station,  S,  and  repeaters,  , 
j — 1 , ...,  m. 

2.  Each  repeater  can  communicate  with  the 
, station  (1  hop  system). 

3.  Each  repeater  has  I disturbing  repeaters  in 
addition  to  itself.  When  I = m-1,  the  following 
analyses  are  exact;  otherwise  approximations 
must  be  used.  Note  the  computational  results 

in  Chapter  8 are  for  I = m-1. 

4.  No  repeater  accepts  Repeater  On  Packets  (ROP's) 
or  End-To-End  acknowledgements  (ETE  Ack's)  from 
other  repeaters. 

5.  Single  channel  slotted  ALOHA  access  scheme. 

6.  When  forwarding  ROP's,  each  repeater  broadcasts 
into  a given  slot  with  probability  p. 

7.  If  a repeater  receives  its  label  from  the 
station,  it  forwards  one  ETE  Ack  into  the  next 
slot  and  halts  transmission  of  ROP's. 
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After  the  station  receives  a ROP  from  a partic- 
ular repeater  for  the  first  time,  the  station  pre- 
pares a label  for  that  repeater  and  places  it  in 
the  label  queue.  We  assume  this  requires  zero  pro- 
cessing time. 

The  station  maintains  the  repeater  label  in  the 
queue  until  it  forwards  the  label  to  the  repeater 
and  receives  an  ETE  Ack,  indicating  the  label  has 
been  received.  When  this  occurs,  the  repeater  is 
considered  labeled. 

When  the  label  queue  is  not  empty,  the  station 
transmits  a label  with  probability  q. 

When  transmitting  a label  the  station  selects  it 
from  the  queue  on  a FIFO  basis.  This  assumption 
diverges  from  the  equivalent  assumption  of  Chap- 
ter 8,  however  for  the  case  of  1 buffer  the  two 
assumptions  agree. 

Whenever  the  station  receives  a ROP  from  a repeater 
for  which  it  already  has  prepared  a label,  it  dis- 
regards the  ROP. 

Zero  propagation  time  for  radio  signals. 

Buffer  size,  b,  i.e.,  the  number  of  labels  in  the 
label  queue  cannot  exceed  b,  b = 1,  2,  . . . , m. 
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15.  If  the  station  or  a repeater  receive  more  than  one 
packet  in  the  same  slot,  it  is  assumed  that  all 
packets  are  in  error  (zero  capture) . 

It  can  be  noted  that  at  any  time  during  the  initialization  process, 
a repeater  will  have  one  of  the  following  statuses: 

1.  Transmitting  ROP's,  but  has  not  successfully 
sent  one  to  the  station. 

2.  Transmitting  ROP's,  but  has  already  successfully 
sent  one  to  the  station. 

3.  Received  label  from  station  in  previous  slot,  will 
forward  ETE  Ack  to  station  in  next  slot. 

4.  Awaiting  another  label  from  station.  It  has 
received  at  least  one  label  from  the  station  but 
the  subsequent  ETE  Ack('s)  were  unsuccessful. 

In  this  case  the  repeater  is  not  transmitting  ROP's 
since  it  has  a label.  However,  the  station  did 
not  receive  an  ETE  Ack  to  the  label;  hence  it  will 
keep  on  transmitting  the  label  to  the  same  repeater. 

5.  Completed  initialization  - repeater  has  received 
label  from  station  and  forwarded  a successful 
acknowledgement . 

As  in  Chapter  8 for  the  complete  interference  case,  let  iik  be 
the  number  of  repeaters  having  status  i,  i=l,  ...»  5,  and  define 
the  Markov  Chain  whose  state  is  the  quintuple 
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From  the  assumptions  it  is  immediately  clear  that: 

5 

1.  E m . = m 

i-1  1 

2.  m0  + m.,  + m.  < b 

2 3 4 — 

3.  m0  + m.  < 1 

3 4 — 

Note  that  these  are  the  same  constraints  used  in  the  previous  model, 
with  the  addition  that  m^  + m^  < 1 (implying  that  m^  < 1) . A re- 
peater in  status  3 has  received  a label  in  the  previous  slot; 
since  the  station  can  only  send  one  label  at  a time,  only  one 
repeater  could  have  such  status;  a repeater  with  status  4 is  one 
that  received  a label  but  has  not  forwarded  successfully  an  ETE  Ack. 
The  FIFO  condition  implies  that  the  station  keeps  on  sending  a label 
to  the  same  repeater,  until  it  successfully  receives  an  Ack;  there- 
fore only  one  repeater  could  be  in  status  4.  Also  the  station  could 
not  pick  a label  for  a repeater  in  status  2,  if  there  is  a backlogged 
repeater  in  status  4.  Thus  we  need  to  impose  m^  + m^  < 1. 

Transition  probabilities  for  this  model  with  complete  inter- 
ference are  derived  in  Appendix  A.  Analogous  to  the  discussion  in 
Chapter  8,  this  new  model  can  be  extended  to  treat  the  general  inter- 
ference case  with  no  conceptual  difficulties.  The  major  complication 
is  that  because  of  the  FIFO  queue  management,  the  model  must  note  the 
order  in  which  the  station  receives  ROP's  from  the  various  repeaters. 
However,  the  computational  complexity  of  the  general  interference 
model  is  again  much  greater  than  that  of  the  complete  interference 
model . 
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9.3  MAIN  RESULTS  - STUDY  OF  INITIALIZATION  TIME  FOR  1 AND  2 


STATION  BUFFERS  FOR  FIFO  LABEL  QUEUE  SERVICE  DISCIPLINE 


In  this  section  we  present  the  closed  form  solutions  for  the 
initialization  times.  Furthermore,  we  study  by  numerical  methods 
the  optimum  values  of  transmission  rates  by  repeaters  and  station 
which  result  in  minimum  initialization  time  as  a function  of  num- 
ber of  repeaters  and  the  interference  between  repeaters.  Finally 
in  Section  9.3.5  we  compare  the  initialization  times  for  1 and  2 
station  buffers. 


In  Appendix  A we  show  that  the  initialization  time  for  a 
single  hop  m-repeater  packet  radio  network  is  given  by: 


Where 


Transmission  rate  of  ROP's  by  an  uninitialized 
repeater 

Station  label  transmission  rate 

Average  number  of  interfering  repeaters,  given 

i rpeaters  are  initialized. 
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9.3.2  Numerical  Results  For  The  Single  Station  Buffer  Case 

The  numerical  study  involved  point-by-point  search  to  obtain 
optimal  parameter  values  accurate  to  two  significant  places.  The 
major  results  are  as  follows: 

Figure  1 depicts  optimal  values  for  the  exact  solution  to  the 
Markov  Chain  with  complete  interference.  Observe  that  for  complete 
interference  the  optimal  station  transmission  rate  is  a constant 
q*  = .44.  Note  that  this  rate  is  higher  than  the  optimal  rate  for 
the  infinite  buffer  case  and  random  service  of  label  queue  of  Chapter 
8.  This  is  due  to  the  fact  that  the  station  must  clear  its  (only) 
buffer  as  soon  as  possible  before  it  can  proceed  with  the  initiali- 
zation . 

Figure  2 depicts  optimal  values  for  the  approximate  non-eomplete 
interference.  Observe  that  for  partial  interference  q*  is  still 
nearly  constant,  but  there  is  a tendency  to  decrease  as  m increases. 
The  optimal  repeater  transmission  rate  for  complete  interference 
case  is  lower  than  the  optimal  repeater  rate  for  non-complete  inter- 
ference. In  this  case,  a frequent  repeater  transmission  blocks 
label  reception,  for  any  other  repeater;  to  alleviate  this,  repeaters 
should  not  broadcast  too  frequently.  On  the  other  hand,  for  marginal 
interference,  a repeater  blocks  only  few  other  repeaters;  thus  we 
can  afford  a slightly  higher  repeater  rate. 

In  Figures  1 and  2 we  see  that  for  both  categories  of  inter- 
ference p*  < i.  Specifically, 

I = m-1,  p*  « — (m  large) 

O 

1=2  , p*  « (m  large) 

Also,  the  initialization  time  decreases  as  the  interference  de- 
creases. For  large  m,  there  is  approximately  a 20%  differential 
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between  the  case  I=m-1  and  1=2.  Figure  3 shows  the  convex  behavior 
and  sensitivity  of  the  initialization  time  as  a function  of  the  para- 
meters. 

Table  1 shows  the  time  required  for  ROP  collection  and  label 
delivery  operation  as  a function  of  the  cycle,  indicating  the  rela- 
tive difficulty  as  initialization  progresses.  A cycle  is  a section 
of  the  state  transition  diagram  of  the  Markov  Chain  initialization 
model  developed  in  Appendix  A.  Cycle  i is  the  section  of  the  dia- 
gram beginning  with  having  i repeaters  initialized  and  ending  with 
having  i+1  repeaters  initialized.  Figure  4 graphically  illustrates 
the  comparison.  Note  that  ROP  collection  becomes  consistently 
harder  as  initialization  proceeds;  label  delivery  becomes  consis- 
tently easier  as  initialization  proceeds.  The  label  delivery  becomes 
easier  since  there  is  less  contention  while  the  ROP  collection  be- 
comes  more  difficult  because  there  are  few  repeaters  which  produce 
acceptable  ROP's.  This  is  true  even  if  the  interference  has  de- 
creased - indicating  that  the  fact  that  there  are  fewer  repeaters 
has  a more  marked  effect. 


9.3.3  Two  Station  Buffer  Case  With  FIFO  Service  Management 


The  total  single  hop  m repeater  initialization  time  (derived 
in  Appendix  B)  is  given  by: 


mp(l-p) 


.m-1  q(l-p)  1-q 


+ £ E[i.] 


where 
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U + (1~q--  (1~p)m-i-2  + [1-d-q)  (1-P)m"i_1] 


(m-i-l)p(l-p) 


(m-i-l)p (l-p)m_i~2 (l-q)+q (1-p) 1 (i) 


+ 1 (m-i-l)p(l-p)m~i~2(l-q) 

(l-p)m"1_1(l-q)  (m-i-1) p (1-p) m_ 1-2 (1-q) +q (1-p) 1 (i) 

U + TTTyH}  U-U-(l-q)  (l-p)m"i+1] 


(m-i-1) p (1-p) m-1-2 (1-q) +q (1-p) 1 ( 1 } 

+ (m-i-1)  p (1-q)  (l-p)1"-1'1 ^ 

p (m-i-1)  (1-q)  (1-p) m"'i*"1+q  (1— p) 1+1  (i) 

{q  (i~p) 1+1  (l)  (i-P)rn-i"1(i-q) 

[1  +[l-(l-p)m"i”1(l-q)]  1 T/.J} 

q (l-p) 1 


where : 

p = Repeater  transmission  rate 

q = Station  transmission  rate 

I(i)  * Average  number  of  interfering  repeaters,  given  i 
repeaters  are  initialized. 

Again  the  expression  is  exact  for  complete  interference. 


TABLE  Is  COMPARISON  OF  TIME  TO  RECEIVE  ith  ROP,  E ii}  , AND  TO  SEND  ith  LABEL,  E. 
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9.3.4  Numerical  Results  For  The  Two  Station  Buffer  Case 


Figures  5,  6 and  7 depict  the  optimal  parameter  values  and 
initialization  time  for  complete  interference,  for  1=2,  and  no 
interference,  respectively,  for  an  m-repeater  network.  The  optimal 
values  were  obtained  by  point-by-point  search  and  are  accurate  to 
two  significant  digits. 

Figure  8 shows  the  initialization  time  as  a function  of  m, 
parameterized  on  I.  The  initialization  time  for  a 1-buffer  system 
is  shown  for  comparison. 

The  following  can  be  observed: 

1.  The  optimal  station  transmission  is  nearly 
constant  at  q*  « .40,  showing  a slight  tendency 
to  decrease  as  m increases. 

2.  There  is  only  a very  small  difference  in  the 
optimal  station  rate  at  low  or  high  interference. 

3.  For  complete  interference  p*  < and  for  large 
m,  p*  « (empirically  determined) . 

4.  As  the  interference  decreases,  p*  increases  (as 

1 8 

expected) ; again  p < — and  p*  « for  large  m. 

5.  As  the  interference  decreases,  the  initialization 
time  decreases.  There  is  a reduction  of  about 
15%  in  initialization  time  as  we  go  from  complete 
interference  to  zero  interference. 


COMPLETE  INTERFERENCE,  TWO  BUFFERS 
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OPTIMAL 

INITIALIZATION  TIME 
(I*.  SLOTS) 


OPTIMAL 
STATION  RATE 

q*) 


OPTIMAL 
REPEATER  RATE 


20  30  40  50  60  70  80  90  100  NUMBER  OF 

REPEATERS 


FIGURE  6:  PARTIAL  INTERFERENCE,  1=2,  2 BUFFERS 
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9.3.5  Comparison  of  1-Buffer  and  2-Buffer  Cases 

A comparison  between  the  above  cases  via  Figures  1 to  8 shows: 

X.  The  station's  optimal  transmission  rate  de- 
creased 10%  as  we  went  from  1 buffer  to  2 
buffers.  This  is  explained  by  the  fact  that 
in  a 2-buffer  situation  there  is  no  pressing 
urgency  to  clear  the  one  occupied  buffer  since 
another  is  available  for  accepting  ROP'si 

2.  The  repeater's  transmission  rates  are  un- 
changed on  the  average,  indicating  that  the 
repeaters  can  be  ignorant  of  the  station's 
buffer  number. 

3.  The  initialization  time  decreased  as  we  went 
from  1 buffer  to  2 buffers.  Approximately 
15%  less  time  is  required  with  two  buffers 
than  with  one  buffer. 

4.  Comparing  these  results  with  the  results  of 
Chapter  8,  we  observe  that  for  a small  number 
of  repeaters,  the  degradation  of  changing 
from  random  selection  of  label  transmission 
to  FIFO  is  of  the  order  of  1%.  Such  de- 
gradation, however,  can  be  expected  to  in- 
crease as  the  network  size  increases. 
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9.4  COMPUTATIONAL  COMPLEXITY 


In  Appendix  A it  is  shown  that  the  number  of  states  in  the 
Markov  Chain  for  the  b station  buffer  case  is: 

b . 

o=  E 3 (m-4+1)  = 3[mb+(b+l) (1-H) ] (4) 

4=0  * 


Observations: 


1.  if  b = 1,  a = 3[m+l] 

2.  if  b = 2 a = 6[m) 

3.  if  3<b<m  o < 3 bra 

Thus  we  see  that  in  all  cases  o=0(bm),  and  for  infinite  buffer 
2 

(b=m) , o=0 (m  ).  The  improvement  in  the  computational  effort  is 
shown  in  Table  2 which  compares  the  number  of  states  of  this  FIFO 
model  for  delivering  labels  to  repeaters  versus  random  service  of 
the  label  queue  (Chapter  8). 


’ 
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9.5  CONCLUSIONS 


Closed  form  solution  for  the  initialization  time  of  a single- 
hop packet  radio  network  were  obtained.  The  solutions  are  for  the 
case  in  which  the  station  has  one  or  two  buffers  for  storing  and 
sending  labels  and  when  it  uses  a first  in  first  out  queue  management 
strategy.  The  slotted  ALOHA  access  scheme  was  assumed.  The  com- 
putational complexity  of  the  models  was  determined;  the  solutions 
were  programed,  and  the  optimum  values  of  repeater • and  station 
transmission  rates  as  a function  of  the  interference  pattern  of 
repeaters  were  experimentally  obtained.  These  optimum  rates  re- 
sult in  minimum  initialization  times. 

The  following  conclusions  emerge  from  the  studies: 

1.  The  initialization  time  with  2 buffers  at  the 
station  is  approximately  15%  smaller  than  with 

1 buffer,  for  the  same  interference  pattern  and 
network  size. 

2.  The  optimal  station  transmission  rate,  q*,  is 
nearly  independent  of  m (number  of  repeaters)  , 
for  both  values  of  the  buffer  size;  however, 
q*  decreased  10%  as  we  went  from  1 buffer  to 

2 buffers.  Thus  q is  a function  of  the  station's 
architecture  only. 

3.  The  optimal  repeater  transmission  rates  were 
independent  of  the  buffer  size  on  the  average, 
indicating  that  the  repeaters  need  not  be  aware 
of  the  station's  buffer  structure. 
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4.  The  optimal  repeater  transmission  rate  in- 
creases about  20%  as  interference  goes  from 
complete  to  zero;  the  initialization  time  de- 
creases about  15%  as  we  go  from  complete  inter 
ference  to  zero  interference. 

5.  In  both  cases  for  large  m optimal  repeater 
transmission  rates  were  proportional  to  1/m 
where  m is  number  of  repeaters  in  the  net- 
work. 
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APPENDIX  A:  DERIVATION  OF  SOLUTION  FOR 

THE  ONE  BUFFER  CASE 

A. 1 Transition  Probabilities 


Because  of  the  assumptions  of  complete  interference  and 
FIFO  it  is  easy  to  compute  the  state  transition  mat_i„.  For 
the  complete  interference  case,  a packet  is  succes-'-Hy  re- 
ceived by  the  station,  if  all  other  repeaters  and  ; o station 
are  silent.  Similarly,  for  a packet  to  be  received  successfully 
by  a repeater  it  is  required  that  all  repeaters  be  silent. 

We  associate  a status  with  each  repeater  during  the  initial- 
ization process.  The  state  of  the  system  is  defined  by  the  number 
of  repeaters  in  each  status.  A repeater  can  have  one  of  the  follow- 
ing statuses: 

1.  Transmitting  ROP's,  but  has  not  successfully 
sent  one  to  the  station. 

2.  Transmitting  ROP's,  but  has  already  successfully 
sent  one  to  the  station. 

3.  Received  label  from  station  in  previous  slot, 
will  forward  ETE  Ack  to  station  in  next  slot. 

4.  Awaiting  another  label  from  station.  It  has 
received  at  least  one  label  from  the  station 
but  the  subsequent  ETE  Ack('s)  were  unsuccess- 
ful. In  this  case  the  repeater  is  not  trans- 

ft 

mitting  ROP's  since  it  has  a label.  H vtiver, 
the  station  will  continue  to  transmit  : he 
label  to  the  same  repeater,  since  it  d^d  not 
receive  an  ETE  Ack  to  the  label. 
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5.  Completed  initialization  - repeater  has  received 
label  from  station  and  forwarded  a successful 
acknowledgement . 

Given  the  present  state  of  the  chain,  (m  m2,  m^,  n»4,  m,.),  where 
nu  is  the  number  of  repeater  in  status  i,  the  following  list  enu- 
merates all  possible  transitions.  We  consider  m2=0  and  m^=l  sep- 
arately. 

1.  No  repeater  received  a label  in  the  previous 
slot  (m3=0) 

a.  Successful  ROP  when  station  queue  is  not 
empty.  This  requires  m1>0,  0<m2+m4<b. 

Transition  to  state  (m^-1,  m2+l,  m4» 

m,.)  occurs  with  probability 

m.+m^-l  , 

(l-q)!^  p(l-p)  X = Zv 

b.  Successful  ROP  when  station  queue  is 
empty.  This  requires  m^X),  m2+m4=0. 

Transition  to  state  (m^-1,  m2+l,  m4' 

m1+m2-l 

m,.)  with  probability  m^pfl-p)  = Z^. 

t H 

Since  B^  and  B^j^  represent  probabilities 
of  mutually  exclusive  events,  we  will  use 

I 

one  notation  B1  which  will  denote  B.  or 
B^ , depending  on  the  event. 

c.  Successful  label  to  a repeater  with  status  2. 

This  cannot  occur  in  the  present  model  unless 
m4=0.  Transition  to  state  (m^,  m2~l,  1,  n»4,  m5) 

m.  +m~ 

with  probability  Z2=(l-p) 
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Successful  label  to  the  repeater  in  status  4. 
This  requires  m4>0.  Transition  to  state  (m^, 


1,  m4-l,  m5)  with  probability  ( 1— p) 


ml+m2 


e.  Else  remain  in  same  state.  With  probability 
1_Zl"Z2_Z3* 

2.  Some  repeater  received  a label  in  the  previous  slot. 
(m3=l,  m4=0) 

a.  Successful  ETE  Ack.  Transition  to  state 
(n»1#  n»2#  0,  m4,  m5+l)  occurs  with  prob- 
m,+m5 

ability  (1-p)  A (1-q) . 


Unsuccessful  ETE  Ack;  transition  to  state 
(n^,  m2»  0,  m4+l,  m5)  with  probability 
m.  +m~ 

l-(l-p)  1 ^(1-q). 


3.  If  the  present  state  is  (0,0,0,0,m)  go  to 
state  (m, 0,0, 0,0)  with  probability  1. 

It  is  elementary  to  verify  that  a unique  stationary  vector, 

T th 

(II^ r JI2, . . .nn)  , exists  for  this  chain.  Also,  if  the  n1"  state 

is  completely  labeled  state,  (0,0,0,0,m),  then  the  expected  inter- 
arrival time  between  visits  to  state  n is  Hence,  the  expected 

initialization  time  is  1/n  - 1. 

n 


Alternatively,  one  could  define  T^  to  be  the  time  to  reach  the 
completely  initialized  state  from  state  i.  Suppose  at  the  current 
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time  the  state  of  the  Markov  Chain  is  i and  a transition  to  state 
j occurs  (where  j may  equal  i) . Then  it  is  easy  to  derive 


EITJ  "^transition,  _ 1 + E,Tj) 


Unconditioning  we  obtain 


E[T.]  = £ (1+E [T . ] ) P..  = 1 + £ E [T . ] P.. 

j J J j J J 


(A.  1) 


(A. 2) 


where  P^j  is  the  i,  j element  of  the  state  transition  matrix. 
This  results  in  a set  of  simultaneous  equations  that  could  be 
solved  to  obtain  E[T^)  for  all  i.  In  the  following  sections  we 
obtain  closed  form  solutions  for  these  equations  with  1 and  2 
buffers. 


A. 2 Number  of  States  in  the  Chain 


Consider  the  quintuple  (m^,  m2,  m^,  , m,.) . Let  & ROP's 

be  in  the  buffer  (i.e.,  t = n^+m^+ing)  and  m-&  be  in  state  1 or  5. 
Since 


1.  m^  £ 1 


2.  m.  < 1 

4 — 

3.  m_  + m.  < 1 

3 4 — 

We  see  that  given  £ elements,  there  are  only  three  ways  in  which 
to  partition  them  according  to  statuses  2,  3 and  4,  namely. 


1.  m2  ~ *-“1 


2.  m2  = *-1 


3.  m2  = A 


m3  = 0 


m3  = ! 


m3  = 0 


m4  = 1 


»4  “ 0 


m4  = 0 
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On  the  other  hand  there  are  m-Jl+1  ways  the  m-£  elements  can  be 
partitioned  in  the  two  statuses,  1 and  5.  Thus,  if  o represents 
the  number  of  possible  states  of  the  above  chain,  by  summing 
over  all  allowable  values  of  X, , we  find 

a = E 3(m-£+l)  = 3 [mb  - -(^)-  + (b+1)] 

1=0  (A. 3 

= 3 [mb  + (b+1)  (1  - |)] 

A. 3 Solution  to  1-Buffer  Markov  Chain  Model 

By  a cycle  of  a Markov  Chain  we  mean  a section  of  the  state 
transition  diagram.  We  consider  cycles  C^  such  that 

1.  The  C^'s  are  disjoint. 

2.  Any  state  of  the  chain  belongs  to  one  cycle. 

3.  C^  and  C^+^,  when  considered  as  graphs,  are 
isomorphic  for  all  but  possibly  the  first  and 
last  case. 


The  solution  strategy  involves  computing  the  expected  time  to 
traverse  one  cycle,  and  then  summing  these  over  cycles  0,1,..., m-1. 
To  clarify  the  analytical  procedure  to  be  followed  we  illustrate  in 
Figure  9 a cycle  of  the  state  transition  diagram  for  the  1-buffer 
case.  SR,  SL,  SE,  UE  represent  successful  ROP,  successful  label, 
successful  ETE  Ack  and  unsuccessful  ETE  Ack,  respectively. 

The  cycle  starts  with  the  state  (m-i,  0,0,0,i)  representing 
m-i  unlabeled  repeaters  and  i labeled  repeaters.  The  following 
states  are  depicted  in  Figure  9: 
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• 

°i 

= chain 

at  beginning  of  cycle 

• 

h 

= chain 

after  SR 

• 

2i 

= chain 

after  SL 

• 

3i 

= chain 

after  UE 

• 

°i+l 

= chain 

at  next  cycle  = 

chain 

after  SE 

(m-i,  0,0, 0,i) 
(m-i-1, 1, 0, 0 , i) 
(m-i-1 , 0, 1, 0, i) 
(m-i-1, 0,0, l,i) 

(m-i-1, 0,0,0, i+1) 


The  simplification  that  allows  us  to  solve  the  1 buffer  and 
2 buffer  models  with  relative  ease  is  that  in  each  case  there  are 
m+1  states  that  must  be  entered  in  moving  from  state  (m, 0,0, 0,0) 
to  state  (0,0,0,0,m).  By  defining  cycles  in  the  appropriate,  we 
take  advantage  of  this.  For  buffer  sizes  greater  than  2,  this 
is  not  true. 

Note  that  for  the  1 buffer  case,  the  expected  time  to  initial- 
ize the  last  m-k  repeaters  (after  k repeaters  have  been  initialized) 
equals  the  expected  time  to  initialize  a network  with  k repeaters. 
This  is  not  true  for  larger  buffer  sizes. 

Let  E [I ^ ] be  the  expected  time  to  go  through  cycle  i;  then 
if  I represents  the  expected  initialization  time. 


m-1 

I = E E [I.  ] (A.  4) 

i=0 


Throughout  the  analysis  we  use  the  fact  that  the  geometrical  dis- 
tribution is  memoryless;  that  is,  if  x is  a geometrically  dis- 
tributed random  variable;  then 

Prob(x  >i+j|x>i)  = Prob(x>j)  (A.  5) 

for  i,j  integers. 
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In  our  case  t is  the  time  spent  in  a specific  state  of  the 
Markov  Chain;  the  time  to  leave  any  state  is  geometrically  dis- 
tributed. 

Consider  the  following  particular  scenario.  The  chain  is  in 
state  A.  If  event  E occurs  transition  to  state  B occurs;  else  if 
E (its  complement)  occurs  go  to  state  C.  Remain  in  state  C until 
some  other  event  F occurs  then  return  to  state  A.  See  Figure  10. 
Let  E[TAfi]  and  E I A ] be  the  expected  time  to  go  from  A to  B and 
C to  A,  respectively.  Because  of  the  abovementioned  memoryless 
property: 


E [Tab  | outcome  of  event]  = 


, if  E 


1 + E[Tca]  + EtT^]  , if  E 


(A. 6) 


unconditioning,  if  p(E)  = prob  of  event  E, 


ElT.J  = p (E)  + (l-p(E))  {1  + E[T„J  + EIT^]} 


from  which  one  obtains: 


(A.  7) 


EtTAB>  * 


l+(l-p(E))E[TCA] 

pTe) 


(A.  8) 


Going  back  to  our  Markov  Chain,  let  E[T  ] be  the  expected 


Vi 


time  to  go  from  state  x to  state  y in  cycle  i. 


Then  clearly  from  Figure  9: 


E(i.)  = E[Tq  ] + E[T,  ? ] + E[T?  ] 

uixi  ‘Li  i ^iui+l 

We  examine  each  component  separately.  In  this  analysis  let 

P be  the  transition  probability  of  going  from  state  x in 
xiyi 

cycle  i to  state  y in  cycle  i. 
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A. 3.1  Evaluation  of  E[Tg  1 1 

uiAi 

A transition  from  state  (K  to  state  1^  represents  a successful 
ROP  reception;  this  can  occur  only  if 


1.  The  station  is  silent. 

2.  m-i-1  repeaters  are  silent,  and  one  is 
broadcasting . 

Thus  the  probability  of  this  transition  is: 

PQ  = (m-i)  p(l-p)m_1_1  , i=0, 1, . . . ,m-l  (A. 10) 

i i 

Finally  since  the  distribution  of  time  spent  in  state  0.  is 
geometric  we  obtain: 


E[T0ili1  ’ p 


°i1i  (m-i)p(l-p) 


m-i-1 


(A. 11) 


A. 3. 2 Evaluation  of  EfT^  ^ ] 

xi  l 

A transition  from  state  1^  to  state  2^  represents  a successful 
label  delivery;  this  can  occur  only  if 


1.  The  station  transmits. 


2.  The  repeater  in  question  is  silent. 

3.  All  the  repeaters  which  can  interfere  with  the 
repeater  in  question  are  silent. 
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Thus  the  probability  of  this  transition  is 


where  I(i)  is  the  number  of  interfering  repeaters  at  cycle  i.  For 
complete  interference  I (i)  = m-i  for  all  repeaters  and  our  result  is 
exact.  For  non-complete  interference  I (i)  £ min(I,m-i).  Thus  for 
the  latter  case  one  is  restricted  to  an  approximation.  Two  conceivable 
approximations  are: 


min (I, m-i) 


(1+1) 


The  second  approximation  has  been  implemented  into  our  computa 
tional  routines  and  is  subsequently  referred  to  as  the  linear 
decrease  approximation. 


I (i+1) 


This  is  the  only  case  that  needs  some  thought.  Note  that 
from  state  2^  we  can  go  directly  to  state  0^+^,  if  the  ETE  Ack 
transmission  is  successful,  and  to  state  3^  if  the  ETE  Ack  trans- 
mission is  unsuccessful.  We  condition  on  this  event.  In  this 
case  we  can  apply  the  analysis  developed  for  the  scenario  depicted 
in  Figure  10;  doing  so,  we  obtain: 


pwi  HUMIWJI 
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Since  such  an  ETE  Ack  is  received  if  all  active  repeaters  and  the 
station  are  silent,  we  have: 


since  all  interfering  repeaters  must  be  silent  and  the  station 
must  broadcast.  Thus  the  expected  time  is: 


because  the  distribution  of  the  time  spent  in  state  3^  is 
geometric.  We  thus  have 


Finally,  the  total  expected  initialization  time  is  obtained  by 
summing  the  three  quantities  obtained  above,  over  every  cycle. 
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We  have  thus  derived  the  exact  solution  for  the  1-buffer  Markovian 
model  with  complete  interference  and  an  approximate  solution  for 
the  general  interference  case. 

Conceptually  the  same  approach  can  be  applied  to  treat  the 
general  interference  case,  but  the  development  is  very  laborious. 
In  this  case  it  is  necessary  to  know  specifically: 

(1)  Which  repeaters  have  already  been  initialized 

. til 

prior  to  the  1 cycle. 

(2)  Which  repeater  is  labeled  during  the  i*"*1  cycle 
given  item  (1) . 

(3)  Expected  time  to  complete  the  ifc^  labeling, 
given  (2 ) . 

Then  in  order  to  compute  total  expected  initialization  time,  it 
is  necessary  to  compute  probabilities  for  items  (1)  and  (2)  for 
all  possible  combinations.  A cursory  analysis  indicates  that 
computing  probabilities  for  item  (2)  and  expected  time  in  (3) 
is  relatively  easy,  but  computing  the  probabilities  for  (1) 
would  be  laborious.  Most  likely  this  would  have  to  be  computer- 
ized (rather  than  deriving  a closed  form  solution) , and  even 
then,  because  of  the  computational  complexity,  only  small  networks 
could  be  analyzed. 
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APPENDIX  B:  DERIVATION  OF  SOLUTION  FOR  A 2 BUFFER 

MODEL  WITH  FIFO  SERVICE  DISCIPLINE 

B. 1 General  Strategy 

It  has  been  stated  above  that  close  form  computations  are 
relatively  easy  when  the  number  of  states  by  which  one  can  enter 
a cycle  is  one.  To  achieve  this,  we  must  alter  slightly  the 
definition  of  cycle  employed  in  Appendix  A.  Let 


Cycle  -1 


start  with  (m, 0,0, 0,0) 
end  with  (m-1 , 1, 0, 0 , 0) 


Cycle  i 


start  with  (m-i-1, 1, 0, 0, i) 

end  with  (m-i-2, 1, 0, 0, i+1) , i=0, 1, 2, . . . ,m-2 


Cycle  m-1 


start  with  (0, 1, 0, 0,m-l) 
end  with  (0,0,0,0,m) 


Note  that  Cycle  -1  involves  only  the  successful  sending  of  a ROP 
to  the  station  while  the  cycle  m-1  involves  only  the  labeling  of 
the  last  repeater  after  all  others  have  been  labeled,  after  this 
repeater  has  successfully  sent  a ROP. 

Thus  at  the  beginning  of  Cycle  i,  i=0, 1, . . . ,m-2,  there  are 
m-i-1  repeaters  with  status  1,  1 repeater  with  status  2,  and  i 
repeaters  with  status  5. 

Figure  11  illustrates  the  states  for  a typical  cycle  0£i£m-2. 
The  same  nomenclature  of  the  previous  section  has  been  employed  in 
Figure  11;  notice  that  now  there  are  three  separate  classes  of 
routes  which  the  chain  can  take  to  traverse  the  cycle.  Each  cycle 
starts  with  1 ROP  in  the  buffer.  Either  one  of  the  following 
classes  of  routes  can  be  taken: 


9.B.1 


1 


L 16« 


Observe  that,  except  for  the  number  of  unlabeled  repeaters, 
this  section  of  the  state  diagram  is  the  same  as  a cycle  for  a 
1-buffer  problem.  As  in  the  previous  section 


E[im-1]  = E[T1  2 1 + E[T2  0 1 

m 1 m-1  m-1  m-1  m-1 

■ qTT^pT  + P,  \ U + EtT3m  .2  > <l-p2m  .0  >>  <B-3> 

i u . m-1  m-1  m-l  m-1 

m-l  m-1 


where  P,  n = prob  (ETE  Ack  is  successful.) 
m-1  m-1 


Since  every  repeater  is  silent  at  this  stage,  we  only  require 


thus  P 


giving  the 


•'  'T*p,  t-"'  * 
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B.3  Evaluation  of  E[I^],  i=0 , 1 , . . . ,m-2 

For  a typical  cycle  i,  we  are  interested  in  quantifying 
the  time  needed  to  traverse  it.  Such  time  is  made  up  of  various 
components,  as  indicated  below. 

B.3.1  Computation  of  E [T,  , ] 

xi  i+1 

To  compute  this  expression  assume  that  at  the. current  slot 
the  state  of  the  chain  is  1^,  then  condition  on  the  outcome  of 
the  next  slot.  Reasoning  as  in  Appendix  A,  it  is  easy  to  derive 


P.  _ = Prob  (go  from  1.  to  2.)  = q(l-p) 

xi  i 1 1 


1+1  (i) 


(B . 5) 


P^  ^ = Prob  (go  from  1^  to  4^)  = (1-q) ( 1— p ) m X ^p(m-i-l)  (B.6) 

Then,  referring  to  Figure  11,  we  see  that 


1 + E[T,  . ] 

ii+l 


if  a label  is 
delivered 


r outcome  of  , 

lAl^l^+^  next  slot  J 


1 + E[T  . ] 

^i  i+l 


if  a ROP  is 
received 


(B.  7) 


1 + EfT.  . ] if  neither  of 

±i1i+l  the  above 


where  we  have  made  use  of  the  memoryless  property  described  above. 
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Unconditioning  we  obtain: 


E [T 


Vi+1 


] = (1  + E[T2  1 ])  P,  , + (1  + E[T 


1.2. 


i i+1  Ai*i 


]>  Pi 


4.1.  1 ' "1  4 

ixi+l  iiqi 


+ (1  + E[T  . ]) (1-P  -P  ) 

i i+1  Ai  i xxi 


Solving  for  E [T.  , ] , we  obtain: 

i i+1 


E[T  . ] = 

i i+1 


1 + P1.2.  E[T2.1.  1 + P1  4 lT4  1 1 

ii  i i+1  Ai4i  i i+1 


Pli2i  + Pli4i 


We  notice  that  to  proceed  we  need  E [T0  , , . ] and  E [T . ]; 

2.1.+1  4i1i+l 


x 1 


we  address  E [T . . ] next. 

*ixi+l 


B.3.2  Computation  of  E[T.  ] 

i1i+l 


Referring  to  Figure  11,  we  see  that 


E[T.  . ] = E[T,  5 ] + E [T_  , ] 

ii+l  i i siAi+l 


(B. 


(B. 


(B. 


We  now  evaluate  the  epxressions  on  the  right-hand  side  of  Eq.  (B.10) 
It  is  quite  simple  to  show  that: 


E[T4  5 1 = P"1—  = T+TTTT 

4i5i  P4.5.  q(l-p)1+I(l) 


(B. 


/ 


since  we  require  a successful  label  delivery  from  the  state 
(m-i-2,2,0,0,i) . 
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To  obtain  E[Tc  , ] we  must  condition  on  the  outcome  of  the 

iiii+l 

next  slot,  namely  whether  the  ETE  Ack  is  successful  or  not.  Using 
the  analysis  applied  to  Figure  9 in  Appendix  A we  find: 


E[T5  1 1 = P 

Dii+1 


Vi+1 


U + E[T,  ] (l-P-  , )> 

6i5i  Vi+l 


(B. 12) 


Note  that: 


P = (l-p)m"i“1(l-q) 

'’li+l 


(B . 13)* 


since  we  are  in  state  (m-i_2, 1 , 1 , 0, i) , and  the  station  and  all  other 
unlabeled  repeaters  must  be  silent  for  the  ETE  to  be  successful. 
Reasoning  as  in  Appendix  A Section  3,  we  obtain: 


ElT6  5 1 = p = 

6i5i  P6i5i  qtl-p) 


I (i) 


(B. 14) 


since  one  less  repeater  is  now  active  after  state  6^  is  reached. 


Finally: 
E [T 


] = 


4i1i+lJ  _ qd-p)1+I(i) 


(l-p)m'i-1(l-q) 


{1  + [1- (l-p)m_i_1 (1-q) 1 


. I (i) 


rr) 


(B. 15) 
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B.3.3 


Evaluation  of  E[T 


2.1  J 

iXi+l 


Assuming  the  current  state  of  the  chain  to  be  2^  and  condi- 
tioning on  the  event  of  the  next  slot,  namely  whether  the  ETE  Ack 
is  successful,  we  immediately  see 


p r t event  of  , 

2i1i+l  next  slofcJ 


1 + E<T0.1.  > 

1 1+1 

1 + E [T,  . ] 

^ii+l 


if  ETE  Ack 
successful 

if  ETE  Ack 
unsuccessful 


(B. 16) 


Note  that  (see  Figure  11) : 


2i^i  = Pr°k  (ETE  Ack  is  successful  from  state  2^)  = 
= (1-q)  (l-p)1"-1-1 


(B. 17) 


Unconditioning,  we  get: 


ElTWpVi,1  + E[Vi+11> 


+ (1  + E [T,  , ]) (l-p?  n ) 

Ji  i+1  i l 


(B. 18) 


Since 


E (T 


1 - 


°i1i+l  (m-i-l)p (l-p)m-1~2 


(B. 19) 


(due  to  the  fact  that  the  station  is  automatically  silent  when 
the  label  queue  is  empty)  we  obtain: 


E[T?  J * 1 + P,  n — -.-y 

2i1i+l  2i°i  (m-i-1) p (1-p) m 1 2 


+ (l-P,  ) E[T,  - ] 

iui  JiJ-i+l 


(B. 20) 


Thus  we  need  to  find  E [T,  . ]. 

Ji1i+1 
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B.3.4  Evaluation  of  E[T,  , ] 

~ ■Jixi+1 

Note  this  calculation  is  more  complicated  than  the  single 
buffer  case  because  it  is  possible  to  transfer  from  3i  to  6^, 
i.e.,  another  ROP  is  received  before  label  delivery.  Again  we 
condition  on  the  next  slot. 


. event  of  , 

ll3^1^+1  next  slot* 


1 + E[T„  . ] , if  label  successful 

11+I 

1 + E [T,  . ] , if  ROP  successful 

6i1i+l 

T.  + E [T,  . ] , if  neither 

Ji1i+1 

(B. 21) 


Unconditioning : 


E [T,  . ] = (1  + E[T  ])  P + (1  + E[T  x ])  P3  6 

3i1i+l  2iXi+l  3i2i  bi1i+l  i i 


+ d + e[t3>1  ])(i-p3i1 


i i+1 


where 


P_  , = Prob  (ROP  is  successful  from  state  3. ) 

3.o. 


= (m-i-l)p (l-p)m_i-2(l-q) 


P 2 = Prob  (label  is  successful  from  state  3^) 

1 1 = q(l-p)I(i) 
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Solving,  we  obtain: 

1 + P 


E[T  , ] = 

^i^i+l 


•>  o E [T~  -l  It  P-j  c E [T,  1 ] 

3,2,  2.1.+1  3.6.  6.1.+1 


1 1 


\h  + Sh 


(B. 25) 


E[T,  . J can  be  written  as: 

Vi+l 


E[T  . ] = EfT,  . ) + E[T5  , ] 

Vi+l  6i5i  Vi+l 


(B. 26) 


where: 


ElT6.5  ] = 


i i q(l-p) 


TUT 


(B.  27)* 


\ and  EfTp.  . ] was  derived  in  B.3.2. 

'>iii+l 

Hence  we  obtained  an  equation  for  E[T,  . ] in  terms  of  E[T~  , ]. 

1 i+1  i^i+l 

Together  with  the  equation  of  subsection  3,  we  have  a system  which 

must  be  solved  simultaneously. 


B.3.5  Evaluation  of  E [T^] : The  Final  Result 


We  now  pull  things  together;  from  subsection  B.3.1  we  have: 

P, 

1 


e It.  . 1 = 


Vi 


E [ T 

li±i+l  "1,2,  T "1,4,  "1,2,  ^ "1,4,  Vi+l 


1 1 
P 


i 1 ii  ii 


^i4i 


^*1  2 + ^*1  4 

Vi  ii4i 


E[T.  , 1 

4iJ"i+l 


(B. 28) 
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From  subsection  B.3.2  we  have: 


"Vw1  ■ E,TVi’ + {1  +' E,Vi’  (1'Vi+1u  (B-29’ 


i i+l 


We  only  need  E[T,  , J.  From  subsections  B.3.3  and  B.3.4  we  have: 

^i^i+l 


E [T 


W = 1 + E,Vi+1’ + <l-Vi’E,V 


i+l 


] (B. 30) 


and 


E[T0  , ) = 


Vi+l 


3.2. 

1 j.  i i p [in  1 

P3.6.  + P3 . 2 . P3.6.  + P3,2.  2i1i+l 


i~i  l l 

P. 


li  li 


3.6. 

i-ip EtT  5 ] + E[T  ] 

P3i6i  + P3i2i  l i i i+l 


(B. 31) 


The  following  procedure  is  employed: 


1.  Substitute  E[T_  , ] (which  has  been  computed 

^i-i+l 

above)  into  equation  (B.31). 


2.  Solve  the  system  of  equations  (B.30)  and  (B.31) 

for  E[T,  . ]. 

^ii-1 

3.  The  answer  to  2 is  in  terms  of  E[TA  ] which  was 

bi  i 

derived  above;  substitute  such  expression. 
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We  thus  have  E[T_  , ],  namely: 

li+l 


EIT,  , ] = 

^i^i+l 


{1  + (1-q) (1-P) 


m-i-1 


(m-i-1) p (1-p) 


1 rjrj  + tl-d-q)  (I-p)1"'1"1]. 


m- 


[ 


1 

(m-i-1) p (1-p) m-i-2 (1-q)  + q(l-p)1 

(m-i-1) p (1-p) m~i~2 (l-q) 

(m-i-1  )p  (1-p) m*’i~2  (1-q)  + q (1-p) 1 


in 

nr 


(l-p)IJ,"1"1n-rr/ 


(1-q) 


H + 


q(l-p) 


I (i) 


■]]) 


m-i-1 


I (i) 


-1 
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(1”P) ( 1-q) 


(m-i-l)p(l-p)ln~i~2(l-q) 

(m-i-1) p (1-p) m_i~2 (1-q)  + q(l-p)I(i: 


[1  + 


q(l-p) 


u - [i-(i-q)  (i-P)m~i~1i-g(i-P)I(i)  }~ 

(m-i-1) p (l-p)m-1_2 (1-q)  + q(l-p)I(l) 


(m-i-1) p (1-q) (1-p) 


m-i-1 


p (m-i-1) (1-q) (l-p)m~1-1  + q(l-p)1+I(l) 


{ ..  1.  + _ .1, 
q(l-p)1+I(l)  (1-p) m-1-1 (1-q) 


[1+  (l-p)*1*-1-1  (1-q)  ] 


qd-P) 


I (i)  1 } 


Thus  we  have  accomplished  our  goal  of  determining  the  expected 
time  to  traverse  a typical  cycle.  Summing  over  all  cycles  gives 
the  total  expected  initialization  time. 
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